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IN THE CLAIMS: 

The text of all pending claims, (including withdrawn claims) is set forth below. Cancelled 
and not entered claims are indicated with claim number and status only. The claims as listed 
below show added text with underlining and deleted text with str i kothrough . The status of each 
claim is indicated with one of (original), (currently amended), (cancelled), (withdrawn), (new), 
(previously presented), or (not entered). 

1 . (Previously Presented) An image processing device for determining three- 
dimensional position and/or orientation of an object, comprising: 

image data capturing means for capturing image data containing an image of the object; 

reference model pattern creating means for creating a reference model pattern based on 
image data of a reference object with a three-dimensional reference orientation relative to said 
image capturing means captured by said image capturing means, said reference object having a 
shape substantially identical to that of the object; 

transformation means for performing two-dimensional and geometrical transformation on 
the created model pattern using a plurality of parameter sets to generate a transformed model 
pattern representing an image of the object with a three-dimensional orientation different from 
the reference orientation; 

pattern matching means for performing a pattern matching of the image data of the 
object captured by said image capturing means with the transformed model pattern; 

selecting means for repeatedly performing the generation of a transformed model pattern 
and the pattern matching of the image data of the object with the transformed model pattern to 
thereby select one of the transformed model patterns in conformity with the image data of the 
object, and obtain information on a position of the image of the object in the image data; 

means for obtaining information on a position of the image of the object in accordance 
with the selected one of the transformed model patterns in the image data; 

means for obtaining information on the three-dimensional orientation of the object based 
on one of the parameter sets used for generating the selected one of the transformed model 
patterns; and 

determining means for determining three-dimensional position and/or orientation of the 
object based on the information on the position of the image of the object in the image data and 
information on the three-dimensional orientation of the object. 

2. (Previously Presented) An image processing device for determining three- 
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dimensional position and/or orientation of an object, comprising: 

image data capturing means for capturing image data containing an image of the object; 

reference model pattern creating means for creating a reference model pattern based on 
image data of a reference object with a three-dimensional reference orientation relative to said 
image data capturing means captured by said image data capturing means, said reference 
object having a shape substantially identical to that of the object; 

transformation means for performing two-dimensional and geometrical transformation on 
the created reference model pattern using a plurality of parameter sets to generate a plurality of 
transformed model patterns each representing an image of the object with a three-dimensional 
orientation different from the reference position; 

storage means for storing the plurality of transformed model patterns and the parameter 
sets used in generating the respective transformed model patterns to be associated therewith; 

pattern matching means for performing pattern matching of the image data of the object 
captured by said image capturing means with the plurality of transformed model patterns to 
thereby select one of the transformed model patterns in conformity with the image data of the 
object, and obtain information on a position of the image of the object in the image data; 

means for obtaining information on a position of the image of the object in accordance 
with the selected one of the transformed model patterns in the image data; 

means for obtaining information on the three-dimensional orientation of the object based 
on one of the parameter sets used for generating the selected one of the transformed model 
patterns; and 

determining means for determining three-dimensional position and/or orientation of the 
object based on information on the position of the image of the object in the image data and the 
information on the three-dimensional orientation of the object. 

3. (Original) An image processing device according to claim 1 or 2, wherein said 
transformation means performs the two-dimensional and geometrical transformation of an affine 
transformation, and said image processing device further comprises additional measuring 
means for obtaining a sign of inclination of the object with respect to said image capturing 
means. 



4. (Original) An image processing device according to claim 3, wherein said 
additional measuring means performs dividing of a model pattern into at least two partial model 
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patterns which are subject to the affine transformation to generate transformed partial model 
patterns, and pattern matching of the image data of the object with the transformed partial model 
patterns to determine most conformable sizes, and determines the sign of the inclination based 
on comparison of the sizes of the conformable partial model patterns with each other. 

5. (Original) An image processing device according to claim 3, wherein said 
additional measuring means performs measurement of distances from a displacement sensor 
separately provided in the vicinity of said image capturing means to at least two points on the 
object using the displacement sensor, and determines the sign of the inclination based on 
comparison of the measured distances. 

6. (Original) An image processing device according to claim 3, wherein said 
additional measuring means performs additional pattern matching of image data of the object 
captured after said image data capturing means is slightly moved or inclined and determines the 
sign of the inclination based on judgment whether an inclination of image of the object becomes 
larger or smaller than the selected one of the transformed model patterns. 

7. (Original) An image processing device according to claim 1, wherein the image 
processing device is incorporated into a robot system comprising: 

storage means storing an operating orientation of the robot relative to the object or 
storing an operating orientation and an operating position of the robot relative to the object; and 

robot control means for determining an operating orientation of the robot or the operating 
orientation and an operating position of the robot based on the determined three-dimensional 
position and/or orientation of the object. 

8. (Original) An image processing device according to claim 7, wherein said image 
capturing means is mounted on the robot. 
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